From NVIDIA Megatron-LM for visibility by RaymondLi0 · Pull Request #18 · bigcode-project/Megatron-LM

RaymondLi0 · 2023-01-24T20:01:13Z

No description provided.

This reverts commit 1123fc0.

Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>

This reverts commit 9119fae.

Co-authored-by: oliver könig <okoenig@nvidia.com> Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>

…ger (#3362)

Signed-off-by: meg miranda <mmiranda@nvidia.com> Co-authored-by: Philip Petrakian <pgpetrak@gmail.com> Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>

Signed-off-by: sajadn <snorouzi@nvidia.com>

Co-authored-by: xielaixin <xielx@shanghaitech.edu.cn>

Co-authored-by: litianjian <litianjian@bytedance.com> Co-authored-by: Yan Bai <baiyan1996@icloud.com> Co-authored-by: Siddharth Singh <sidsingh@nvidia.com> Co-authored-by: Robert Kirby <rkirby@cw-dfw-cs-001-vscode-01.cm.cluster> Co-authored-by: Robert Kirby <rkirby@nvidia.com> Co-authored-by: Robert Kirby <ArEsKay3@users.noreply.github.com> Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com> Co-authored-by: oliver könig <okoenig@nvidia.com>

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>

Co-authored-by: yobi byte <yobibyte@users.noreply.github.com>

Co-authored-by: liming127 <liming127@meituan.com>

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

Co-authored-by: Jon Barker <jbarker@oci-hsg-cs-001-vscode-01.cm.cluster> Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>

Signed-off-by: lit <lit@nvidia.com>

Signed-off-by: oliver könig <okoenig@nvidia.com>

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

Signed-off-by: dimapihtar <dpihtar@gmail.com>

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

…aph when running eager (#3815)

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com> Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster> Co-authored-by: shanmugamr1992 <shanmugamr1992@gmail.com>

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: Charlie Truong <chtruong@nvidia.com>

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>

…ed (#3851) Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>

Signed-off-by: dimapihtar <dpihtar@gmail.com>

Signed-off-by: oliver könig <okoenig@nvidia.com>

Signed-off-by: gkollu <gkollu@nvidia.com> Signed-off-by: Gautham Kollu <gkollu@nvidia.com> Co-authored-by: oliver könig <okoenig@nvidia.com>

Signed-off-by: Maanu Grover <maanug@nvidia.com>

#3564) Signed-off-by: Asha Anoosheh <aanoosheh@nvidia.com> Co-authored-by: Chenhan Yu <chenhany@nvidia.com> Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: Charlie Truong <chtruong@nvidia.com>

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>

…ecisionPolicy be… (#3810) Signed-off-by: Cory Ye <cye@nvidia.com> Co-authored-by: oliver könig <okoenig@nvidia.com>

Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com> Co-authored-by: oliver könig <okoenig@nvidia.com>

Signed-off-by: oliver könig <okoenig@nvidia.com>

Signed-off-by: dimapihtar <dpihtar@gmail.com>

…ence_optimized MoEs (#3858) Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>

RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12

RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12

ko3n1g and others added 26 commits February 13, 2026 00:26

Revert "Move to using the Inference OpenAI API server (#3107)"

4184bfa

This reverts commit 1123fc0.

Update moe github test cases. (#3077)

9119fae

Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>

Revert "Update moe github test cases. (#3077)"

e0aa16b

This reverts commit 9119fae.

Split layer_specs to return Submodules instead of ModuleSpecs (#3255)

28ccdaa

Co-authored-by: oliver könig <okoenig@nvidia.com> Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>

ci: Remove gpu sanity check (#3420)

76a9f47

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

[Critical-Bug] Fix Uneven PP for Mamba models (Nemotron3-nano) (#3399)

d10eb6f

Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>

Fix for rl (#3390)

2611830

Add check for full_iteration scope before instantiating CudaGraphMana…

4578ed8

…ger (#3362)

Fix broken links throughout (#3230)

698feec

Signed-off-by: meg miranda <mmiranda@nvidia.com> Co-authored-by: Philip Petrakian <pgpetrak@gmail.com> Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>

Extract intermediate embeddings of transformer block (#3060)

d401490

Signed-off-by: sajadn <snorouzi@nvidia.com>

Update copy-pr-bot.yaml [skip ci]

545bff9

Decouple topk and loss from DSA Indexer (#3248)

b890099

Co-authored-by: xielaixin <xielx@shanghaitech.edu.cn>

Make Mamba inference state memory ratio configurable (#3322)

4beb8ca

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>

Fix configs for RL model environments (#3441)

cbb47c8

Replace pickle with json in rl_utils (#3351)

8f1c2f8

Co-authored-by: yobi byte <yobibyte@users.noreply.github.com>

fix: correct typo in demo training example (#3428)

057c804

Co-authored-by: liming127 <liming127@meituan.com>

Clean up logging inside inference flask server (#3437)

b218e64

ci: Update release-docs workflow to use FW-CI-templates v0.72.0 (#3438)

3c69780

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

Fix --tokenizer-hf-include-special-tokens (#3422)

74ef64e

Co-authored-by: Jon Barker <jbarker@oci-hsg-cs-001-vscode-01.cm.cluster> Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>

Update num_tokens_to_generate default for Gym (#3453)

267cf1f

Fix slowdown in inference flask server (#3445)

0627623

Add a normalized scale for MTP per token loss (#3159)

a22c40e

Signed-off-by: lit <lit@nvidia.com>

[Bugfix] Fix nan loss caused by zero token in MTP (#3396)

d7500d4

Signed-off-by: lit <lit@nvidia.com>

ci: Add testing branches

ad5a627

Signed-off-by: oliver könig <okoenig@nvidia.com>

chore: rotate oncall schedule

cd71d4c

ko3n1g force-pushed the main branch from ad5a627 to cd71d4c Compare February 18, 2026 09:18

Log RL metrics per environment (#3446)

f1908bc

chtruong814 and others added 30 commits March 12, 2026 21:39

ci: Skip test_wrong_cuda_graph_impl_returns_false in LTS (#3847)

b250472

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

ci: Mark TestCoordinator.test_throughput as flaky (#3849)

7ca9dc5

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

find optimal number of workers (#3699)

f261906

Signed-off-by: dimapihtar <dpihtar@gmail.com>

remove encoder_and_decoder (#3836)

b7437fe

Signed-off-by: dimapihtar <dpihtar@gmail.com>

ci: Skip more tests in test_vision_cuda_graphs for LTS (#3860)

8a806e5

Signed-off-by: Charlie Truong <chtruong@nvidia.com>

Ensure that inference dummy_forward does not try to match on a cudagr…

90fee1f

…aph when running eager (#3815)

Add unit tests for speculative decoding (#3817)

d1b8e27

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com> Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster> Co-authored-by: shanmugamr1992 <shanmugamr1992@gmail.com>

Fix flakiness due to timing between shutdowns (#3857)

d4ac04f

Exposing interleave argument for fused_apply_rotary_pos_emb_thd (#3794)

87eb3c2

ci: install nvidia-resiliency-ext from source (#3861)

9a19203

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: Charlie Truong <chtruong@nvidia.com>

Miscellaneous inference bug fixes (#3840)

f8becec

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>

Nemo-RL integration bugfixes for --transformer-impl inference_optimiz…

905c0e3

…ed (#3851) Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>

chore(beep boop 🤖): Bump (main) (2026-03-16)

5dca153

remove legacy mpu (#3854)

b5b1994

Signed-off-by: dimapihtar <dpihtar@gmail.com>

enable async save for functional tests (#3855)

086777a

Signed-off-by: dimapihtar <dpihtar@gmail.com>

remove legacy data (#3853)

925341d

Signed-off-by: dimapihtar <dpihtar@gmail.com>

docs: Document python-gitlab dependency (#3863)

8334576

Signed-off-by: oliver könig <okoenig@nvidia.com>

Fsdp dsv3 proxy (#3844)

9a494f1

Signed-off-by: gkollu <gkollu@nvidia.com> Signed-off-by: Gautham Kollu <gkollu@nvidia.com> Co-authored-by: oliver könig <okoenig@nvidia.com>

Fix token dispatched cudagraph_attrs (#3625)

feeb1b4

Fix slowdown in serialization (#3872)

3b34761

Establish reviewers for training code (#3765)

c1a14fb

Signed-off-by: Maanu Grover <maanug@nvidia.com>

Use fp32 state dtypes for Mamba inference functional test (#3888)

72b10a8

Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>

[Megatron-FSDP] Support 'auto' argument which defaults to pre-MixedPr…

ff70b24

…ecisionPolicy be… (#3810) Signed-off-by: Cory Ye <cye@nvidia.com> Co-authored-by: oliver könig <okoenig@nvidia.com>

Bug fix: add missing packages to Multimodal Dockerfile (#3417)

3e9d8ca

Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com> Co-authored-by: oliver könig <okoenig@nvidia.com>

Reverse polarity of the off-policy measurement (#3580)

43675d4

Update nightly golden values after TE2.13 (#3886)

84e0360

Signed-off-by: oliver könig <okoenig@nvidia.com>

enable use_persistent_ckpt_worker for ci tests (#3898)

d3c4b05

Signed-off-by: dimapihtar <dpihtar@gmail.com>

Correctly generate state dict in MultiTokenPredictionBlock (#3624)

02e0ca5

Add torch grouped gemm bf16 and mxfp8 support w/ cuda graphed + infer…

589cd9e

…ence_optimized MoEs (#3858) Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

From NVIDIA Megatron-LM for visibility#18

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 6530 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main

RaymondLi0 commented Jan 24, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

RaymondLi0 commented Jan 24, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants